TITLE OF THE INVENTION 
IMAGE PROCESSING APPARATUS AND METHOD, AND IMAGE 

PROCESSING SYSTEM 

FIELD OF THE INVENTION 

The present invention relates to an image 
processing apparatus and method, e.g., an image 
processing apparatus and method which perform color 
adjustment for an image, and an image processing system. 

BACKGROUND OF THE INVENTION 

When an image displayed on a monitor of a 
computer system or the like is to be printed out from a 
printer, a so-called color matching process is 
generally required which performs adjustment so that 
the appearance of printed colors substantially equals 
the appearance of monitor display colors, since the 
color reproduction region of a monitor largely differs 
from that of a printer. A known example of this color 
matching process is a method of looking up a color 
correction table which is formed by taking account of 
the color characteristics of a monitor and a printer. 

After this color matching process is executed, 
the user sometimes determines, on the basis of the 
image printed by a printer, that a specific color and 
its nearby colors further require fine adjustment. 
This fine adjustment is performed by changing the 



values of the above-mentioned color correction table 
for color matching, or by changing the values of 
individual pixels of the image data. 

If, however, only a specific color is changed in 
a pinpoint manner in order to perform fine adjustment 
as in the above conventional method, density 
discontinuation occurs particularly in gradation images. 

To prevent this problem, there is an adjustment 
method where a masking coefficient is calculated in 
such a way that a specific color becomes a desired 
color, and colors distant from the specific color 
change only slightly. Using the calculated coefficient, 
a masking process is performed for all values in the 
color correction table (or for all pixel values in 
image data) . This method does not cause any density 
discontinuation as described above. With this method, 
however, it is difficult to limit the range over which 
the adjustment has its effect. The method also 
requires a long processing time. 

SUMMARY OF THE INVENTION 
The present invention has been proposed to solve 
the conventional problems, and has as its object to 
provide an image processing apparatus and method 
capable of adjusting a desired color of an image by 
suppressing the occurrence of discontinuation in the 
boundary of a color adjustment region, while 



restricting this color adjustment region, and to 
provide an image processing system. 

It is another object of the present invention to 
provide an image processing apparatus and method by 
which the user can easily predict adjustment results 
and readily designate desired color adjustment, and to 
provide an image processing system. 

As a means for achieving the above objects, an 
image processing apparatus of the present invention has 
the following arrangement. 

That is, an image processing apparatus for 
performing color adjustment for image data is 
characterized by comprising designating means for 
designating, as parameters, a reference color, an 
adjusted color of the reference color, and an 
adjustment region in a color space, region determining 
means for determining whether input image data is in 
the adjustment region, and adjusted value calculating 
means for calculating an adjusted value of the image 
data on the basis of the parameters, if the region 
determining means determines that the image data is in 
the adjustment region. 

Other features and advantages of the present 
invention will be apparent from the following 
description taken in conjunction with the accompanying 
drawings, in which like reference characters designate 
the same or similar parts throughout the figures 



thereof. 



BRIEF DESCRIPTION OF THE DRAWINGS 

The accompanying drawings, which are incorporated 
in and constitute a part of the specification, 
illustrate embodiments of the invention and, together 
with the description, serve to explain the principles 
of the invention. 

Fig. 1 is a block diagram showing the arrangement 
of an image processing apparatus according to an 
embodiment of the present invention; 

Fig. 2 is a view showing an example of data held 
in a color correction table; 

Fig. 3 is a block diagram showing the arrangement 
of a specific color adjusting unit; 

Fig. 4 is a graph for explaining adjustment 
parameters in an RGB space; 

Fig. 5 is a view showing a UI for designating 
ad j us tment parameters ; 

Fig. 6 is a schematic view showing an outline of 
calculations in an adjusted value calculator; 

Fig. 7 is a flow chart showing a specific color 
adjusting process; 

Fig. 8 is a view schematically showing the 
transformation of coordinates by affine transformation; 

Fig. 9 is a schematic view showing an outline of 
an adjustment process inside a unit sphere on object 



coordinates; 

Figs. 10A and 10B are views showing the concept 
of a bounding box in the second embodiment according to 
the present invention; and 

Fig. 11 is a block diagram showing the 
arrangement of an image processing apparatus according 
to a modification of the present invention. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
Preferred embodiments of the present invention 
will now be described in detail in accordance with the 
accompanying drawings . 
<First Embodiment> 

Fig. 1 is a block diagram showing the arrangement 
of an image processing apparatus according to this 
embodiment. Referring to Fig. 1, a color monitor 2 0 
for displaying images and a printer 27 for printing 
images on a printing medium are connected to an image 
processing apparatus 28. 

Components of this image processing apparatus 28 
are a video signal generator 21 for converting image 
data into a video signal, an image memory 22 for 
storing image data, a color correction table 23 which 
stores the correspondence between monitor display 
colors and printed colors, a color matching processor 
24 for matching monitor display colors with printed 
colors by looking up the color correction table 23, a 



specific color adjusting unit 25 for finely adjusting 
an arbitrary color in the color correction table 23, 
and an output image processor 2 6 for converting image 
data into a printer driving signal. 

In this embodiment, image data to be processed is 
digital data obtained by an image input device such as 
a digital camera or scanner, or data generated as 
computer graphics (CG) . This image data is prestored 
as pixel values corresponding to the brightness into 
the image memory 22. More specifically, each pixel 
value has 8 bits for each of red (R) , green (G) , and 
blue (B) . 

In this embodiment, the color monitor 20 is a 
display device such as a CRT or LCD. The printer 27 is 
an ink jet printer which discharges and fixes ink 
droplets of cyan (C) , magenta (M) , yellow (Y) , and 
black (K) onto a printing medium, and expresses a shade 
of color by the density. Note that the color monitor 
20 and the printer 27 are not limited to these forms. 
For example, the printer 27 can also be an 
electrophotographic printer or a heat transfer printer. 

Fig. 2 is a view showing details of the color 
correction table 23. As shown in Fig. 2, when each of 
RGB values of input pixel values is 0, 17, 34, 51, 68, 
85, 102, 119, 136, 153, 170, 187, 204, 221, 238, and 
255, this color correction table 23 holds the 
corresponding RGB values obtained by taking account of 



the output characteristics of the printer 27. 

In the image processing apparatus 28 shown in 
Fig. 1, image data stored in the image memory 22 is 
supplied to the color matching processor 24. This 
color matching processor 24 performs color matching for 
an image to be displayed on the color monitor 20 via 
the video signal generator 21, and for an image to be 
printed out from the printer 27 via the output image 
processor 26. More specif ically, the color matching 
processor 24 calculates output values corresponding to 
individual pixel values of image data by interpolation 
by looking up the color correction table 23. After 
that, the output image processor 2 6 controls the 
discharge of the inks C, M, Y, and K for each of the 
input RGB values. The printer 27 thus reproduces 
desired colors on a printing medium. 

The characteristic feature of this embodiment is 
that if a user determines that it is desirable to add 
more changes to a certain color of an output image 
printed as described above, the specific color 
adjusting unit 25 adjusts the color correction table 23 
to achieve the color matching process desired by the 
user. 

The operation in this specific color adjusting 
unit 25 will be described in detail below. 

Fig. 3 is a block diagram showing details of the 
arrangement of the specific color adjusting unit 25. 



Referring to Fig. 3, an adjustment parameter 
designating unit 10 allows a user to designate, as 
adjustment parameters, RGB values as the reference of 
adjustment (a reference color to be adjusted), RGB 
values after adjustment (an adjusted reference color), 
and a region in which specific color adjustment has its 
effect. A transformation matrix calculator 11 
calculates an affine transformation matrix (to be 
described later) on the basis of the adjustment 
parameters designated by the adjustment parameter 
designating unit 10. A matrix memory 12 stores this 
matrix calculated by the transformation matrix 
calculator 11. A coordinate transformer 13 transforms 
the coordinates of a color to be adjusted into those of 
an adjusted color. A region determinator 14 determines 
whether a color to be adjusted is within the adjustment 
region designated by the user. An adjusted value 
calculator 15 calculates the adjusted color of a color 
to be adjusted. 

Fig. 4 is a view showing a reference color to be 
adjusted, an adjusted reference color, and a color 
adjustment range designated in an RGB color space by 
the user by using the adjustment parameter designating 
unit 10. Referring to Fig. 4, reference numeral 30 
denotes a reference color to be adjusted designated by 
the adjustment parameter designating unit 10; 31, an 
adjusted reference color, i.e., adjusted RGB values of 



the reference color 30 to be adjusted; and 32, an 
ellipsoid having the reference color 30 to be adjusted 
and the adjusted reference color 31 on the major axis. 
This ellipsoid 32 indicates a color adjustment range in 
this embodiment. That is, the specific color adjusting 
unit 25 adjusts colors within the ellipsoid 32 in 
accordance with the adjustment amount of the reference 
color 30 to be adjusted, and does not adjust colors 
outside of the ellipsoid 32. 

Fig. 5 shows an example of the user interface 
(UI) of the adjustment parameter designating unit 10. 
Referring to Fig. 5, an adjustment reference setting 
portion 50 sets the reference color 30 to be adjusted 
and the adjusted reference color 31 as RGB values 
before and after the change, respectively. A region 
setting portion 51 sets the size of the ellipsoid 32 
representing the adjustment region boundary by using 
the dimensions of the major and minor axes. An OK 
setting portion 52 is used when the setting is 
completed. With this UI, the reference color to be 
adjusted, adjusted reference color, and adjustment 
region (ellipsoid) are input. 

Fig. 6 is a two-dimensional schematic view 
showing an outline of the calculations in the adjusted 
value calculator 15. Referring to Fig. 6, reference 
numerals 30, 31, and 32 denote the reference color to 
be adjusted, adjusted reference color, and ellipsoid 



indicating the color adjustment range, respectively, 
which are shown in Fig. 4 and set by the UI shown in 
Fig. 5. Reference numerals 43 and 44 denote the major 
axis length and minor axis length, respectively, of the 
designated ellipsoid 32; 45, an arbitrary color to be 
adjusted present inside the ellipsoid 32; 46, an 
adjusted color of the color 45 to be adjusted; and 47, 
an intersection of the ellipsoid 32 and a straight line 
which passes through the reference color 30 to be 
adjusted and the adjusted reference color 31. When the 
arbitrary reference color 45 to be adjusted is given, 
the adjusted color 46 is set in a position which is a 
point on a line connecting the intersection 47 and the 
adjusted reference color 31, and which is changed in 
the same direction as the movement from the color 45 to 
be adjusted to the reference color 30 to be adjusted. 

Note that in a three-dimensional space, there are 
two minor axes perpendicular to the major axis 43. 
This embodiment assumes that these two minor axes have 
the same length. 

The color adjusting process in the image 
processing apparatus 28 of this embodiment will be 
explained in detail below with reference to a flow 
chart in Fig. 7. 

In step S100, the user designates on the 
adjustment parameter designating unit 10 a reference 
color 30 to be adjusted, an adjusted reference color 31, 
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and the lengths of the major and minor axes of an 
ellipsoid 32 as a region in which this adjusting 
operation has its effect. 

In step S101, an affine transformation matrix for 
5 coordinate transformation is calculated by the 

transformation matrix calculator 11 and stored in the 
matrix memory 22. The method of calculating this 
affine transformation matrix will be explained below. 
In computer graphics technologies, affine 
10 transformation to an ellipsoid which is in an arbitrary 
position at an arbitrary angle from a unit sphere 
centering around the origin and which has a given size, 
and inverse transformation of this affine 
transformation, are often defined. Fig. 8 
15 schematically shows the way affine transformation is 

performed for an ellipsoid and a unit sphere centering 
around the origin. Referring to Fig. 8, the unit 
sphere on the right-hand side is af fine-transformed 
into the ellipsoid on the left-hand side and further 
20 inversely transformed into the unit sphere. Also, the 
reference color to be adjusted and the adjusted 
reference color are af fine-transformed inside the unit 
sphere and the ellipsoid. The coordinate system on the 
right-hand side of Fig. 8 in which the unit sphere is 
25 defined is called an object coordinate system. Letting 

( R ref' G ref' B ref> and < R ref ' ' G ref ' < B ref ' > den0te the RGB V * 1UeS ° f 

the reference color to be adjusted and the adjusted 
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reference color, respectively, the relationship between 
arbitrary RGB coordinates (r R ,g R ,b R ) and object 
coordinates (r 0 ,g 0 ,b 0 ) is represented by the following 

equation: 
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where 9 is the angle between the major axis of the 
ellipsoid and the G axis of the RGB space, a is the 
angle between the major axis and the B axis of the RGB 

10 space, and A and B are the lengths of the major and 
minor axes, respectively, of the ellipsoid. 

A transformation matrix M indicated by the above 
equation and its inverse matrix M" 1 are saved in the 
matrix memory 12 and used in a coordinate 

15 transformation process to be described later. 

Next, the flow advances to step S102, and the 
coordinate transformer 13 transforms the reference 
color 30 to be adjusted and the adjusted reference 
color 31 on the RGB coordinates into object coordinates 
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by using the affine transformation matrix calculated as 
above . 

In step S103, the coordinate transformer 13 loads 
a color P to be adjusted (equivalent to the corrected 
5 RGB values in Fig. 2) from the color correction table 
23, and transforms this color P to be adjusted into 
object coordinates. In step S105, the region 
determinator 14 checks whether the color P to be 
|M< adjusted transformed into the object coordinate system 

O 10 is a point inside the unit sphere centering around the 

ftj origin, i.e., is present within the correction 

p execution range. If the color P to be adjusted is not 

T a point inside the unit sphere, the flow advances to 

step S107, and the coordinate transformer 13 inversely 
I!J 15 transforms the point P in the object coordinate system 

S into the RGB coordinate system. 

On the other hand, if the color P to be adjusted 
is inside the unit sphere, this means that this point 
is present within the correction range. Therefore, the 
20 flow advances to step S106, and the coordinate 

transformer 13 performs the following adjustment by 
using the adjusted value calculator 15. 

Fig. 9 two-dimensionally illustrates an outline 
of this adjusting operation inside the unit sphere. 
25 Referring to Fig. 9, reference numerals 60 and 61 

denote a reference color to be adjusted and an adjusted 
reference color, respectively, in the object coordinate 
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system; 65, a color to be adjusted (corresponding to P 

in the RGB coordinate system) ; 66, an intersection of 

the unit sphere and a straight line which passes 

through the reference color 60 to be adjusted and the 

color 65 to be adjusted; and 67, the adjusted color of 

the color 65 to be adjusted. The adjusted value 

calculator 15 calculates the adjusted color 67 shown in 

Fig. 9 as follows. 

First, the adjusted value calculator 15 

calculates the intersection 66 of the unit sphere and 

the straight line which passes through the reference 

color 60 to be adjusted and the color 65 to be adjusted. 

The adjusted value calculator 15 then calculates a 
distance r x from the reference color 60 to be adjusted 

to the color 65 to be adjusted, and a distance r 2 from 
the color 65 to be adjusted to the intersection 66. 
The adjusted value calculator 15 then sets the adjusted 
color 67 as a point on a straight line connecting the 

intersection 66 and the adjusted reference color 61, 
such that the ratio of a distance r T x from the adjusted 

reference color 61 to a distance r' 2 from the 

intersection 66 equals the ratio of r y to r 2 . 

When the adjusted color 67 is thus calculated in 
step S106, the flow advances to step S107 to transform 
this color into RGB values. In step S108, the obtained 
RGB values are stored in a corresponding position in 
the color correction table 23. In step S109, whether 
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the adjustment process is complete for all colors in 
the color correction table 23 is checked. If not, the 
processes in steps S103 to S109 are repeated. If the 
process is complete for all colors, the specific color 
adjusting process of the color correction table 23 is 
terminated. 

In this embodiment, a reference color is changed 
to a designated color by the above-mentioned specific 
color adjusting process, and no density discontinuation 
occurs in the boundary of the adjustment region. 

Furthermore, in this color adjusting process, the 
adjustment amounts of colors near the reference color 
are determined by geometrical calculations. Since this 
allows an easy intuitive understanding of overall color 
changes by mapping, the user can readily predict 
adjustment results. Accordingly, the user can easily 
designate desired color adjustment. 

Also, the mapping process is performed in the 
object coordinates, so the processing such as 
intersection calculations can be simplified. This also 
speeds up the color adjustment process. 
<Second Embodiment> 

The second embodiment according to the present 
invention will be described below. 

In the above first embodiment, coordinate 
transformation is performed for all colors stored in 
the color correction table 23. This second embodiment 
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is characterized in that a range within which specific 
color adjustment has its effect is roughly calculated 
beforehand, and no coordinate transformation is 
performed for values outside this range. 

Details of the color adjustment process in the 
second embodiment will be described below with 
reference to Figs. 10A and 10B. Assume that the 
arrangement of an image processing apparatus according 
to this second embodiment is the same as the first 
embodiment described above, and that an affine 
transformation matrix for transformation between an RGB 
coordinate system and an object coordinate system is 
already calculated by the same procedure as in the 
first embodiment. 

First, in an object coordinate system shown in 
Fig. 10A, a bounding box 70 of a unit sphere centering 
around the origin is calculated. As shown in Fig. 10A, 
a bounding box is a minimum cube containing the unit 
sphere and has eight vertices (1,1,1), (1,1,-1), 
(1,-1,1) , (-1,1,1), (1,-1,-1) , (-1,-1,1) , (-1,1,-1) , 
and (-1,-1,-1) . 

Subsequently, the coordinates of these vertices 
of the bounding box 70 are transformed into RGB 
coordinates shown in Fig. 10B using the affine 
transformation matrix. Referring to Fig. 10B, 
reference numeral 71 denotes a region in which the 
bounding box 70 is transformed into the RGB 
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coordinates; and 72, a region defined by eight points 
represented by combinations of maximum and minimum 
values Rmax, Rmin, Gmax, Gmin, Bmax, and Bmin of the 
RGB values indicating the region 71. 

A specific color adjusting unit 25 of the second 
embodiment executes the same specific color adjusting 
process (steps S104 to S108 in Fig. 7) as in the first 
embodiment only when a color P to be adjusted loaded 
from a color correction table 23 is within the region 
72 shown in Fig. 10B. That is, letting (r,g,b) be the 
RGB values of the color P to be adjusted, the specific 
color adjusting process is executed only when these 
values meet the following conditions. 

Rmin ^ r S Rmax and Gmin g = Gmax and 

Bmin SS b ^ Bmax 

That is, after the color P to be adjusted is 
loaded from the color correction table 23 in step S103 
of Fig. 7, a process of checking whether this color P 
is in the region 72 shown in Fig. 10B is inserted. 
This process can be executed by a region determinator 
14, for example. If the color P to be adjusted is in 
the region 72, processing from step S104 is executed. 
If the color P is not in the region 72, the flow 
returns to step S103, and the next color to be adjusted 
is loaded from the color correction table 23. 

In the second embodiment as described above, an 
adjustment region is roughly calculated in advance, and 
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no coordinate transformation is performed for values 
outside this range. This achieves faster processing 
especially when the number of data to be processed is 
large. 

<Modif ications> 

The present invention is not limited to the above 
first and second embodiments, and various modifications 
and applications are possible as described below. 
[Adjustment Region] 

In the above embodiments, the boundary of a 
region in which specific color adjustment has its 
effect is defined by an ellipsoid. However, this 
region can also be defined by another geometric figure, 
e.g., a polyhedron such as a rectangular parallelepiped 
or octahedron. 
[Method of Adjustment] 

In the above embodiments, the adjustment amount 
of a color inside the adjustment region is linearly 
changed with respect to the distance from a reference 
color of adjustment. However, this adjustment amount 
of a color can also be nonlinearly changed such that 
the amount decreases as the distance of the color from 
the reference color of adjustment increases. 
[Color Space] 

In the above embodiments, correction in an RGB 
space is explained. However, similar processing can 
also be performed in another color space such as an Lab 



space . 

[Object of Specific Color Adjustment] 

In the above embodiments, the specific color 
adjusting process is performed for values stored in the 
color correction table 23. However, this adjustment 
can also be performed for all pixels of a given digital 
image. 

Fig. 11 is a block diagram showing the 
arrangement of an image processing apparatus 29 
according to this modification. A specific color 
adjusting unit 85 is connected to an image memory 22 
and performs the correction process described in the 
above embodiments for each pixel value of image data 
stored in the image memory 22. 

Accordingly, on the basis of an image displayed 
on a color monitor 20 or an output image printed by a 
printer 27, adjustment desired by the user can be 
performed only for a specific image. Note that the 
adjustment of each pixel is the same as in the first 
embodiment described earlier, so a detailed description 
thereof will be omitted. 
<Other Embodiments> 

The present invention can be applied to a system 
constituted by a plurality of devices (e.g., a host 
computer, interface, reader, and printer) or to an 
apparatus (e.g., a copying machine or facsimile 
apparatus) comprising a single device. 



Further , the objects of the present invention can 
also be achieved by supplying a storage medium storing 
program codes of software for implementing the 
functions of the above embodiments to a system or an 
apparatus , and reading out and executing the program 
codes stored in the storage medium by a computer (or a 
CPU or MPU) of the system or apparatus. 

In this case, the program codes read out from the 
storage medium implement the functions of the present 
invention, and the storage medium storing these program 
codes constitutes the invention. 

As this storage medium for supplying the program 
codes, it is possible to use, e.g., a floppy disk, hard 
disk, optical disk, magnetooptical disk, CD-ROM, CD-R, 
magnetic tape, nonvolatile memory card, and ROM. 

Furthermore, besides the functions of the above 
embodiments are implemented by executing the readout 
program codes by the computer, the present invention 
includes a case where an OS (Operating System) or the 
like running on the computer performs part or the whole 
of actual processing in accordance with designations by 
the program codes and thereby implements the functions 
of the above embodiments. 

Furthermore, the present invention also includes 
a case where, after the program codes read out from the 
storage medium are written in a memory of a function 
extension board inserted into the computer or of a 
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function extension unit connected to the computer, a 
CPU or the like of the function extension board or 
function extension unit performs part or the whole of 
actual processing in accordance with designations by 
5 the program codes and thereby implements the functions 
of the above embodiments. 

In the present invention as has been explained 
above, desired color adjustment can be performed for an 
image by suppressing the occurrence of discontinuation 
□ 10 in the boundary of a color adjustment region, while 

restricting this color adjustment region* 

Furthermore, since a user can readily predict 
adjustment results, he or she can easily designate 
desired color adjustment. 
15 The present invention is not limited to the above 

embodiments and various changes and modifications can 
be made within the spirit and scope of the present 
invention. Therefore, to apprise the public of the 
scope of the present invention the following claims are 
20 made. 
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